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Abstract. The prompt muon contribution to the deep-sea atmospheric muon flux 
£>. ■ can serve as a tool for probing into the small-x feature of the gluon density inside of a 

CO . nucleon, if the muon energy threshold could be lifted to 100 TeV. The prompt muon 

flux underwater is calculated taking into consideration predictions of recent charm 
■ production models in which the small- a; behaviour of the gluon distribution is probed. 

We discuss the possibility of distinguishing the PQCD models of the charm production 
CO ' differing in the small-x exponent of the gluon distribution, in measurements of the 

muon flux at energies 10100 TeV with neutrino telescopes. 

a: 

Submitted to: J. Phys. G: Nucl. Phys. 
1. Introduction 

A correct treatment of the charm hadroproduction is important to the atmospheric muon 
and neutrino studies, since short-lived charmed particles, D , D°, D°, Df, A+, which 
are produced in collisions of cosmic rays with nuclei of the air, become the dominant 
source of atmospheric muons and neutrinos at energies E ~ 100 TeV. Thus, one needs 
to take them into consideration as the background for extraterrestrial neutrinos (for a 
review, see jj)- Muons originating from decay of these charmed hadrons are so called 
prompt muons (PM) that contribute to the total atmospheric muon flux. 

Another aspect of the interest to the charm production relates to the gluon density 
at small gluon momentum fraction x. The gluon density at small x is of considerable 
importance because this strongly influences the charm production cross section, both 
total and inclusive. Recently Pasquali et al. 2, and Gelmini et al. E] have 
analysed the influence of small-x behaviour of the parton distribution functions (PDFs) 
on the atmospheric lepton fluxes at sea level. Based on next-to-leading order (NLO) 
calculations of the perturbative Quantum Chromodynamics (PQCD), they predict PM 
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fluxes at the ground level depending strongly on proton gluon distributions at small x 
scale, x < 10~ 5 . 

The muon spectra underwater computed with the model of Pasquali et al. [2], 
in which used were the MRSD_ j3] and the CTEQ3M [S| sets of PDFs, were recently 
discussed jZHHHO]- In this note, using predictions of the PQCD model [3111] for the charm 
production, we discuss the PM contribution to the deep-sea muon flux at depths typical 
for operating and constructing neutrino telescopes, AMANDA [TU], ANTARES 
Baikal [12], NESTOR [THj . Due to large detector volume and efective area (10 4 — 10 5 
m 2 ) and homogeneity of surrounding matter these underice and deep-sea installations 
have considerable advantages over underground detectors for probing very high-energy 
atmospheric muons. 

Namely, here we try to study a PM flux underwater dependence on the power A 
of the small- x gluon distribution function: xg(x,Q 2 ) oc x~ x . The nature of the small- 
x behaviour of the gluon density is now under extensive discussion (see, for example, 
[HI Q21 HEl El CHI EEH!). The small-a; behaviour of the PDFs is the subject of the deep 
interest because an understanding of the underlying dynamics is far yet from being clear. 

2. PDFs and charm production models 

Due to dominant subprocess in heavy quarks hadroproduction, gg — > cc, the charm 
production is sensitive to the gluon density at small x, where x is the gluon momentum 
fraction. One may evaluate the scale of x in cosmic ray interactions as follows. The 
product of the gluon momentum fraction x\ of the projectile nucleon and that of the 
target x near the charm production threshold (~ 2m c ) is X\X = 4ml/(2mNE ), where 
Eq is the primary nucleon energy in the lab frame. Since a muon takes away about 5% of 
the primary nucleon energy, E ~ 20E fJi , we have x\x = Q.l{m c /m^){m c / E^). Because 
of the steepness of the primary cosmic ray spectrum only large X\ contribute sizeably 
to the atmospheric charm production, so one needs to adopt x\ > 0.1. Taking m 2 ~ 2 
GeV 2 , one may find the range of importance for E^ > 100 TeV to be x < 2 • 10~ 6 . It 
should be stressed, this range is yet outside of the scope of the perturbative next-to- 
leading order global analysis of parton distributions [2*U[ 121j. 

The exponent A in PQCD charm production models El H] covers wide range 
from about 0.5, the value being formerly connected to the Pomeron intercept A in the 
leading order of the Balitsky-Fadin-Kuraev-Lipatov (BFKL) approach [22], to about 
0.1-0.2 (A = 0.13-0.18), values obtained with the NLO corrections |2S] to the BFKL 
scheme. The interactions between Pomerons lead to the increase of the BFKL Pomeron 
intercept [T6j . 

Figure ^ presents the sea-level muon flux measured near the vertical [2H [23 
I2HI [23 EH I2H]- as well as fluxes calculated with taking into account the prompt 
muon contribution. These ones are predictions of the quark-gluon string model 
(QGSM) [3U1 EI] (the dash-dotted line) and the recombination quark-parton model 
(RQPM) [21 E2] (dashed), as well those of a set of PQCD charm production models by 
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Figure 1. Vertical sea-level muon flux data and predictions. Experiments: A - 
Artyomovsk [S3], A - Baksan gSJ, □ - MSU [H], ■ - Frejus EH, O - MACRO EHj, 
• - LVD The lower solid line stands for conventional muons. The rest of curves 
represent the total muon flux, sum of prompt muons and conventional ones. 

Pasquali, Reno and Sarcevic (hereafter PRS - dotted lines with numbers 1, 2, 3) and 
models by Gelmini, Gondolo and Varieschi [Hill] (GGV - thin curves with numbers 0.1 
- 0.5). These models are used further in calculations of the deep-sea muon flux. Let us 
sketch out PQCD models. 

2.1. The model by Pasquali, Reno and Sarcevic 

2.1.1. PRS-1. The PRS-1 model (dotted lines in figures d I2J (identical with the 
PQCD-1 in reference is based on the MRSD_ set The PDF input parameters are 
the followings: xg(x, Qq) ~ x~°- 5 as x — > 0, 4-momentum transfer squared Ql = 4GeV 2 ; 
the sea light quark asymmetry, u < d, is taking into consideration; the QCD scale in 
the minimal subtraction scheme (MS), A^ s = 0.215 GeV, corresponds to the effective 
coupling at the Z boson mass scale a s (M§) = 0.111. The factorization scale is 
fip = 2m c , the renormalization one is [1r = m c , where the charm quark mass, m c , 
is chosen to be equal 1.3. The sea-level prompt muon flux has been parameterized by 
authors j2] with the equation: 

lg[^^' Ac (^) • (cnTW^GeV 2 )- 1 ] = -5-91 + 0.290y + O.U3y 2 - 0.0147?/ 3 , (1) 
where y = lg(x^v). 
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2.1.2. PRS-2. In the PRS-2 model (the same as the PQCD-2 in reference 0) 
CTEQ3M set jH] was used. Corresponding inputs which were utilized in this model 
are Af^ = 0.239 GeV, a s (M|) = 0.112, m c = 1.3 GeV, fjt F = 2m c , fi R = m c , and 
A = 0.286 at Ql = 1.6 GeV. The corresponding approximate expression for the PM 
spectrum is 

lg[^^' Ac (^) • (cm-W^GeV 2 )- 1 ] = -5.79 + 0.345y + 0.105y 2 - 0.0127?/ 3 . (2) 

2.1.3. PRS-3. In this model the CTEQ3M set was also used. Differing from PRS-2 
in the renormalization and factorization scales, /i^ = = m c , this model shows the 
uncertainty relating to the scale choice. In this case the PM spectrum was given as 

lg[^J^ ,Ac (^) • (cnTW^GeV 2 )- 1 ] = -5.37 + 0.0191?/ + 0.156?/ 2 - 0.0153?/ 3 . (3) 
2.2. The model by Gelmini, Gondolo and Varieschi 

Here we present results for the model, among those discussed in which is based on 
MRST set of PDFs j2HI with different values of the exponent A in the range 0.1 — 0.5, 
Q 2 > 1.25 GeV 2 ; a s (M|) = 0.1175. The factorization and renormalization scales are: 

fi F = 2m T , n R = m T , 

where 

m T = (k 2 T + m 2 ) 1/2 , m c = 1.25 GeV, 

and characteristic transverse momentum k F is of ~ m c . 

In order to compute PM flux underwater we parameterize sea-level muon spectra 
of the GGV model (see figure 7 in reference with the formulae: 

' Ac (^) = A (j^j cm-VV^GeV- 1 . (4) 

In table [T] five sets of the parameters to equation (J1J) are presented for different values 
of the index A of the small-x gluon destribution. 

Table 1. Parameters of the prompt muon spectrum at sea level (@J. 
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A, 10~ 6 
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72, lO" 2 
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0.1 


3.12 


2.70 


-0.095 


1.49 


-0.2148 


0.2 


3.54 


2.71 


-0.082 


1.12 


-0.0285 


0.3 


1.80 


2.38 


0.045 


-0.82 


0.911 


0.4 


0.97 


2.09 


0.160 


-2.57 


1.749 


0.5 


0.58 


1.84 


0.257 


-4.05 


2.455 
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3. The conventional muon flux 

The main source of the atmospheric muons up to ~ 50 TeV are decays of secondary 
cosmic ray pions and kaons. The flux (conventional) of (tt, fQ-muons is computed 
based on the nuclear cascade model by jHHJ (see also jH2l Ell)- High-energy 
part of this spectrum for the vertical may be approximated with the equation (in 



Zenith-angle distribution of atmospheric muons at sea-level was computed in the 
reference jHS] where detail comparison between the calculated atmospheric muon spectra 
and the sea- level experimental data at different zenith angles was made (see also [5]). 
The conventional muon flux computed for the vertical direction is shown in figure ^ (the 
lower solid line). 

Each of five thin lines in figure presents the sum of the conventional muon 
flux © and the GGV prompt muon flux (J3J) corresponding to the exponent A = 
0.1, 0.2, 0.3, 0.4, 0.5 (numbers near lines). Dotted lines show the same for PRS models, 
equations (001). For comparison there are also shown contributions due to the quark- 
gluon string model and the recombination quark-parton one [HU E2j (the dash-dot line 
and the dash line respectively). Ratios of prompt muon fluxes to the conventional 
one are shown in figure El As one can see, the crossover energy for the PM flux and 
conventional one covers the wide region from ~ 150 TeV to ~ 3 PeV, that is more than 
one order of the magnitude. 

It is worth to note that old QGSM prediction [31] at high energies is within GGV 
prompt muon fluxes as well that of RQPM is within PRS results (figures ^El) • 

4. Prompt muon component of the flux underwater 

Muon energy spectra and angle distributions of the flux underwater was computed with 
the method by 36J. The collision integral in the kinetic equation includes the energy 
loss of muons due to bremsstrahlung, direct e + e~ pair production and photonuclear 
interactions. The ionization energy loss and the small-f part of the loss due to e + e~ 
pair production (v < 2 ■ 10~ 4 , where v is the fraction of the energy lost by the muon) 
were treated as continuous ones. 

In our calculations of underwater muon fluxes at different zenith angles, we used, 
as a boundary spectra, PQCD PM fluxes calculated only for the vertical direction at the 
ground level, supposing the isotropic approximation for prompt muons to be a reliable 
at least for 10 4 <E^< 10 6 GeV at zenith angles 9 < 80°. 

The prompt muon fraction of the flux underwater, R pm , defined as ratio of the 
prompt muon integral spectrum to the conventional one, is presented in figure El for the 



cm 




for E l <E^E 2 , 
for Ea > E 2 



(5) 



where E x = 1.5878 x 10 3 GeV, E 2 = 4.1625 x 10 5 GeV. 
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Figure 3. Prompt muon contribution at h = 4km w. e. vs. E^. 
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Figure 4. Ratio of the prompt muon flux underwater to the conventional one as a 
function of cos 6 at E„ > 100 TeV. 



depth of 4 km of the water equivalent (w. e.) and for cos# = 0.2. As is seen from this 
figure, R pm related to the gluon density slope A = 0.5 is a factor 3 greater than that for 
A = 0.1 at > 10 TeV. 

Zenith-angle distributions of the prompt muon contribution at depths 1-4 km w. e., 
calculated for > 100 TeV, are shown in figurelU Here we used predictions of the GGV 
model for two values of the gluon density exponent, A = 0.1 (dash) and A = 0.5 (solid). 
As one can see in figurelU R pm increases for the vertical direction from about 0.2 at the 
depth of the Baikal NT (1.15 km) [TJ to about 0.5 at the NESTOR depth (~ 4 km) [13]. 
For the larger zenith angles, 9 ~ 75°, this contribution becomes apparently sizable at 
depths 3 — 4 km. Differences in the predictions owing to a change of A, from 0.1 to 0.5 
(see h — 2 and 3 km w. e.), are also clearly visible: the ratio R pm (X = 0.5)/ R pm (X = 0.1) 
at h — 2 km w. e. grows from about 1.5 to about 5 as cos# changes from 1 to 0.2. 

Here we supposed no differences between PRS and GGV calculations apart from 
those related to the charm production cross sections. Actually one needs to compare 
the primary spectrum and composition, nucleon and meson production cross sections 
and other details of the atmospheric nuclear cascade being used in above computations. 
These sources of uncertainties would be considered elsewhere. 
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5. Summary 

In order to test the small- a; gluon distribution effect we have computed deep-sea prompt 
muon fluxes using predictions of charm production models based on NLO calculations 
of the PQCD [2]-[I]. The possibility to discriminate the PQCD models, differing in 
the slope of the gluon distribution, seems to be achievable in measurements of the 
underwater muon flux at energies 50-100 TeV. 

Hardly appeared at sea level for energies up to 10 5 GeV (figures dEl), a dependence 
on the spectral index A of the small-x gluon distribution becomes more distinct at depths 
3 — 4 km w. e. (figures El EJ)- At the depth of 4 km and at the angle of ~ 78° one 
could observe the PM flux to be equal, for A = 0.5, to the conventional one even for 
muon energy ~ 10 TeV (the crossover energy). While for A = 0.1 the crossover energy 
is about 70 TeV. For the high energy threshold, > 100 TeV, and at h < 3 km w. e., 
the ratio R pm is nearly isotropic up to ~ 60°. The "crossover zenith angle" at a given 
depth, 9 c (h), depends apparently on the small- x exponent A of the gluon density inside 
colliding nucleons: 

cos# c |a=o.5 — 0.3 and cos# c |a=o.i — 0.1 for h = 3 km w. e. 
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